Creation of 21st century anatomy facilities: designing facilities for integrated preclinical education in the Middle East.

BACKGROUND: The establishment of new anatomy facilities needs to accommodate a combination of modern teaching modalities that best align with evidence-based best teaching practices. This article describes the process in which our state-of-the-art anatomy laboratories were designed and implemented, and how these facilities support aspects of modern anatomy education. METHODS: A list of best practices for anatomy education in a modern medical curriculum was summarized from the literature. To assess student satisfaction, a survey related to student perception of the anatomy facilities (5-point Likert scale) was conducted. RESULTS: Our educational modalities include a broad range of teaching approaches. The Instructional Studio houses prosected and plastinated specimens, and cadaveric dissections are performed. Each of our three Dry Laboratories allow for active learning and interaction between small student groups. The Webinar Room acts as a conference room for departmental and online meetings, discussions with students, and dialogues with affiliated hospitals via the internet. The Imaging Center is equipped with a Sectra® medical educational platform, CAE Vimedix® Virtual Medical Imaging Ultrasound Training System, and Philipps Lumify® Ultrasound devices to train students to conduct and interpret sonographic images. Moreover, the Complete Anatomy® program is made available to all our students. CONCLUSION: The layout of our newly created Anatomy Facilities allows for all aspects of modern medical education mentioned in the literature. These educational modalities and teaching approaches are highly appreciated by our faculty and students. Moreover, these technologies allowed for a smooth transition from on-site anatomy teaching to online education during the COVID pandemic.

[Suturing basic procedural skills training for medical students during COVID-19 pandemic]. / Entrenamiento procedimental básico (EPROBA) en suturas para estudiantes de medicina durante pandemia por SARS-CoV-2 (COVID-19).

BACKGROUND: The adoption of sanitary measures due to the SARS-CoV-2 pandemic hampered teaching and learning methods in medicine. AIM: To communicate the results of a wound suture training workshop, based on the Basic Procedural Skills Training methodology and adapted to the pandemic context. MATERIAL AND METHODS: One hundred fourteen students were randomized in small groups due to sanitary measures and trained with a modification of the Basic Procedural Skills Training methodology. An informed consent was obtained from every student. The suturing skills were evaluated before and after the intervention with "The Objective Structured Assessment Of Technical Skills" (OSATS) instrument. The perception of the workshop and the implementation of the COVID-19 prevention measures were also evaluated. RESULTS: The students showed a statistically significant improvement after the intervention. In the OSATS verification list, the average score increased from 4.5 to 8.6 (p < 0.01). In the OSATS global scale, the average score increased from 13.0 to 25.3 (p < 0.01). The perception of the workshop and the prevention measures were well evaluated. CONCLUSIONS: Despite all the limitations of the pandemic context, we achieved a significant improvement after the intervention and a very good perception by the students.

A comparison of academic and clinical assessments between endodontic residents receiving in-person versus virtual instruction.

OBJECTIVES: Due to the COVID-19 pandemic, all modes of instruction were moved to virtual teaching for the matriculating endodontic residents at Boston University (BU) School of Dental Medicine (2020-2021). As dentistry is a very hands-on profession, the switch to virtual teaching comes with its own issues of concept retention, zoom fatigue, and limited interaction/lack of engagement between residents and faculty. There has already been a steady decline in the attendance of live lectures by medical and dental students, with students underscoring the ease of watching online lectures/recorded lectures and learning at their own pace. METHODS: This study took a mixed method observational research approach, with one group receiving the standard in-person (IP) teaching the previous year, and the other group receiving the new intervention of virtual teaching the subsequent year via the zoom platform. The two groups received the same curriculum in its entirety. End-of-semester written and oral exams were compared between the two cohorts along with their clinical assessment forms. One focus group was conducted individually with each class for the qualitative portion of this study. RESULTS: The class of residents receiving IP instruction scored higher in both written and oral components of the end-of-semester exam. There was no statistically significant difference between the groups in their clinical performance and both groups improved in their exams and clinical performance over time. Focus groups highlighted themes emphasizing the importance of social connectedness and interactions, engagement, individual learning styles and motivating factors, zoom fatigue, and the need for a hybrid model of education. CONCLUSIONS: Although there was a difference in an exam performance of residents receiving IP versus virtual instruction, there was no impact on their clinical performance. However, subjectively, the lack of social connectedness impacted the overall learning experience.

Development of Hands-On Skills in Diagnostics of Lung Diseases Using Ultrasonography in Undergraduate Medical Education.

This study evaluated advanced pulmonary ultrasonography training for COVID-19 lung examination. Students completed identical pretests and post-tests and a survey. Changes were found for individual questions and overall scores (all P≤.02), specifically image identification, previous material, and COVID-19 questions. Students were receptive to the training for education and future practice (P<.001), and they felt capable using ultrasound for diagnosis and management of COVID-19 patients. Pulmonary ultrasonography training should be considered for the medical school curriculum.

The Effectiveness of Online-Only Blended Cardiopulmonary Resuscitation Training: Static-Group Comparison Study.

BACKGROUND: Basic life support (BLS) education is essential for improving bystander cardiopulmonary resuscitation (CPR) rates, but the imparting of such education faces obstacles during the outbreak of emerging infectious diseases, such as COVID-19. When face-to-face teaching is limited, distance learning-blended learning (BL) or an online-only model-is encouraged. However, evidence regarding the effect of online-only CPR training is scarce, and comparative studies on classroom-based BL (CBL) are lacking. While other strategies have recommended self-directed learning and deliberate practice to enhance CPR education, no previous studies have incorporated all of these instructional methods into a BLS course. OBJECTIVE: This study aimed to demonstrate a novel BLS training model-remote practice BL (RBL)-and compare its educational outcomes with those of the conventional CBL model. METHODS: A static-group comparison study was conducted. It included RBL and CBL courses that shared the same paradigm, comprising online lectures, a deliberate practice session with Little Anne quality CPR (QCPR) manikin feedback, and a final assessment session. In the main intervention, the RBL group was required to perform distant self-directed deliberate practice and complete the final assessment via an online video conference. Manikin-rated CPR scores were measured as the primary outcome; the number of retakes of the final examination was the secondary outcome. RESULTS: A total of 52 and 104 participants from the RBL and CBL groups, respectively, were eligible for data analysis. A comparison of the 2 groups revealed that there were more women in the RBL group than the CBL group (36/52, 69.2% vs 51/104, 49%, respectively; P=.02). After adjustment, there were no significant differences in scores for QCPR release (96.9 vs 96.4, respectively; P=.61), QCPR depth (99.2 vs 99.5, respectively; P=.27), or QCPR rate (94.9 vs 95.5, respectively; P=.83). The RBL group spent more days practicing before the final assessment (12.4 vs 8.9 days, respectively; P<.001) and also had a higher number of retakes (1.4 vs 1.1 times, respectively; P<.001). CONCLUSIONS: We developed a remote practice BL-based method for online-only distant BLS CPR training. In terms of CPR performance, using remote self-directed deliberate practice was not inferior to the conventional classroom-based instructor-led method, although it tended to take more time to achieve the same effect. TRIAL REGISTRATION: Not applicable.

Perspectives, benefits and challenges of a live OSCE during the COVID-19 pandemic in a cross-sectional study.

OBJECTIVES: Restrictions due to the COVID-19 pandemic mandated fundamental changes to student evaluations, including the administration of the observed structured clinical examination (OSCE). This study aims to conduct an in-person OSCE to verify students' practical skills under necessary infection control practices and the impact of face masks on student-patient interactions. DESIGN: Cross-sectional design. SETTING: The OSCE at Medical School of Tuebingen takes place in October 2020. PARTICIPANTS: A total of 149 students (third year of study) completed the survey (RR=80.1%). It was their first OSCE. PRIMARY AND SECONDARY OUTCOME MEASURES: Primary outcome measure was how this type of OSCE was evaluated by participating students in regard to preparation, content and difficulty as well as in real life. Secondary outcome measures were how the implemented hygiene actions influenced the OSCE, including the interaction and communication between students and standardised patients (SPs). Items were rated on a 6-point Likert scale (1=completely to 6=not at all). Means, SDs, frequencies and percentages were calculated. RESULTS: 149 students, 32 SPs and 59 examiners participated. The students rated the OSCE with 2.37 (±0.52) for preparation and 2.07 (±0.32) for content. They perceived the interaction to be significantly disrupted by the use of face masks (3.03±1.54) (p<0.001) compared with the SPs (3.84±1.44) and the examiners (4.14±1.55). In general, the three groups considered the use of face masking the OSCE to be helpful (1.60±1.15). CONCLUSIONS: An in-person OSCE, even in the midst of a global pandemic, is feasible and acceptable to both students and faculty. When compared the students' results to previous students' results who completed the OSCE before the pandemic, the results indicated that students felt less prepared than under non-pandemic circumstances; however, their performances on this OSCE were not lower.

The effectiveness of online team-based learning in introduction to medical ethics education for medical students at a medical college of Nepal: a pilot study.

BACKGROUND: The effectiveness of online classes is always a concern, and it can be overcome by opting for active learning strategies like team-based learning (TBL). This study was conducted to find out the effectiveness of online TBL as an active learning strategy. We also aimed to explore the satisfaction and perception of students toward TBL. METHODS: This is a mixed-method study conducted among 29 third-year Bachelor of Medicine and Bachelor of Surgery (MBBS) students of Gandaki Medical College using purposive sampling method in the duration of January to September 2021. Three two hours online TBL sessions were used for teaching introduction to medical ethics. The individual readiness assurance test (IRAT) scores were compared to the group readiness assurance test (GRAT) scores to evaluate the effect of TBL through cooperative learning. Learner reactions and satisfaction of students towards TBL were assessed using a validated questionnaire comprising of a five-point Likert scale. An open-ended question asking the participants to describe their overall experience of the TBL sessions was also included to explore their perceptions towards TBL. The data were collected using Google form and exported to Microsoft Excel and the quantitative data were then analyzed using Statistical Package for Social Sciences (SPSS) version 16.0. To check the normal distribution of the data, Kolmogorov Smirnov and Shapiro-Wilk test were used. Non-parametric tests were used for the non-normally distributed data. P value of < 0.05 was regarded as significant. Thematic analysis was conducted for the qualitative data. RESULTS: The median GRAT scores were significantly higher (p = 0.006 in TBL 1 and 0.001 in TBL 2) than IRAT scores. Learner reactions toward TBL sessions were positive as shown by the mean scores which were in the range of 3.59 to 4.66. Five themes were generated from the codes: "effective learning method", "positive experience", "gained knowledge", "expression of gratitude" and "the way of conduction of the sessions". CONCLUSION: Online TBL in medical ethics was effective as a teaching learning tool in our setting. The students were satisfied with the learning process and rated the learning strategy positively.

Implementation and evaluation of a Tele-OSCE in oral and maxillofacial surgery - a pilot report.

Background: The ongoing changes in learning and education towards digitalisation have been rapidly accelerated by the COVID-19 pandemic. Especially in dental education where contact to the oral cavity is an integral part of training the chosen digital examination methods and training formats must undergo high requirements to full fill the goal of a real alternative to face-to-face exams. Therefore, this study compared student performance in a newly developed Tele-OSCE with a prior OSCE examinations in presence within an oral- and maxillofacial surgery curriculum. Methods: Study participants were fourth-year (in a five year curriculum) dental students and board certified maxillofacial surgeons (examiners) that took part in a newly developed Tele-OSCE that comprised three five-minute stations (structured facial examination, management mandibular fracture and squamous cell carcinoma) using the zoom® software. Student performance was measured using validated OSCE-Checklists and compared to a previous OSCE examination from the winter term 2019 with the same OSCE stations that was conducted in presence. Significant differences were tested using the Mann-Whitney U test. Furthermore, the new Tele-OSCE was evaluated by students and examiners using previously developed questionnaires. Results: Sixty-six dental students (study group: n=34, summer term 2021, control group: n=32 winter term 2019) and nine examiners participated in the study. Compared to previous non-pandemic OSCEs, there were no significant (p=0.53) differences in overall student performance. Evaluation of the Tele-OSCE showed that the demonstration and rating of practical skills was limited due to missing standard patients or phantoms, however, students did not fear to be misjudged. The demonstration and rating of anamnestic and consultation competencies was seen as unproblematic by students and examiners. Discussion: This pilot-study showed the feasibility of a Tele-OSCE as a formative examination in dental education. However, both students and examiners felt that the demonstration and assessment of practical skills was limited due the new examination format. Nevertheless, Tele-OSCEs might offer an alternative to enable students to complete their dental training.

Assessment during Covid-19: quality assurance of an online open book formative examination for undergraduate medical students.

BACKGROUND: The spread of COVID-19 pandemic in early 2020 compelled all the educational activities, including medical education to be shifted from face-to-face interaction to a virtual platform. This shift provided opportunities for exploring online assessment modalities. One such assessment method is an online open book exam which is a unique concept in medical education of Pakistan. Limited information is available in literature regarding open book exam for the basic science subjects. Hence, the objective of the study was to determine the quality of the open book exam administered as a pilot project to the first-year medical students. METHODS: It was a cross-sectional analytical study that included 99 students of first year MBBS. The students were administered an online unrestricted type of open book exam as a formative assessment. The exam consisted of 30 open-ended, short answer type questions. The scores of the exam were analyzed for psychometric quality. RESULTS: The mean score was 47.24 ± 15.30 SD %. The reliability of the exam was 0.79. The majority (66.6%) of items were found to be moderately difficult with their difficulty index ranging from 31 to 80%. The majority (86.6%) items were in the range of moderate to high discrimination. There were no questions with negative discrimination. CONCLUSIONS: The exam was found to be reliable and can be implemented with training of faculty and students. Online open book exam provides a good format for remote and formative assessment of students with minimum proctoring during times of constraints such as COVID-19 pandemic.

Experience with an OSCE anamnesis station via Zoom: Feasibility, acceptance and challenges from the perspective of students, simulated patients and examiners during the COVID-19 pandemic.

Aim: Assessments of practical clinical competencies pose a challenge during the COVID-19 pandemic. Reports about OSCE stations administered online show that, despite technical feasibility and acceptance, there is a lingering desire for in-person assessments. Barriers and challenges must therefore also be identified in regard to the future integration of digital competencies into the curriculum. Based on a study investigating the feasibility and acceptance of an online OSCE anamnesis station and the descriptions given by students, simulated patients and examiners of the challenges and limitations, we make recommendations for necessary future adaptations to anamnesis training and testing in the context of telemedicine. Method: We surveyed students after completion of an OSCE anamnesis station, adapted to the telemedical setting, that was administered as an alternative assessment to 149 students via Zoom^®. Using semi-structured interviews, we analyzed the resulting challenges and limitations as seen by all of the participants. Results: We confirm the existence of good technical and organizational feasibility, positive learning experiences through feedback, the acquisition of clinical competencies, and a high acceptance of this format as an alternative assessment during the pandemic. Using the semi-structured interviews, it was also possible to analyze additional categories that identify necessary adaptations of this type of format. Conclusion: Adaptation of the content-based training for all of the participants and a targeted revision of the checklists, e.g., regarding communication techniques in a telemedicine setting, is required due to the effects of the online format on communication and interactions between students and simulated patients.

Virtual Objective Structured Clinical Examination Experiences and Performance in Physical Medicine and Rehabilitation Residency.

BACKGROUND: Virtual education has been described before and during the COVID-19 pandemic. Studies evaluating virtual objective structured clinical examinations with postgraduate learners are lacking. This study (1) evaluated the experiences of all participants in a virtual objective structured clinical examination and (2) assessed the validity and reliability of selected virtual objective structured clinical examination stations for skills in physical medicine and rehabilitation. METHODS: Convergent mixed-methods design was used. Participants included three physical medicine and rehabilitation residency programs holding a joint virtual objective structured clinical examination. Analysis included descriptive statistics and thematic analysis. Performance of virtual to previous in-person objective structured clinical examination was compared using independent t tests. RESULTS: Survey response rate was 85%. No participants had previous experience with virtual objective structured clinical examination. Participants found the virtual objective structured clinical examination to be acceptable (79.4%), believable (84.4%), and valuable for learning (93.9%). No significant differences between in-person and virtual objective structured clinical examination scores was found for three-fourth stations and improved scores in one fourth. Four themes were identified: (1) virtual objective structured clinical examinations are better for communication stations; (2) significant organization is required to run a virtual objective structured clinical examination; (3) adaptations are required compared with in-person objective structured clinical examinations; and (4) virtual objective structured clinical examinations provide improved accessibility and useful practice for virtual clinical encounters. CONCLUSIONS: Utility of virtual objective structured clinical examinations as a component of a program of assessment should be carefully considered and may provide valuable learning opportunities going forward.

COVID-19 Pandemic: Effects of Replacing Clinical Hours With Virtual Simulation in BSN Prelicensure Nursing Education.

ABSTRACT: At the onset of the COVID-19 pandemic, many academic institutions suspended in-person instruction and clinical experiences. Virtual simulation played an essential role in providing alternatives. The current study used faculty and student surveys, along with standardized exit exams and NCLEX-RN® pass rates, to determine the effect of using virtual simulation instead of traditional hospital clinical experiences during the final semester of a prelicensure BSN program. Results indicated a small decrease in exit exam scores compared to those who completed the traditional clinical experience and no significant relationship between NCLEX-RN pass/fail rates.

Development of a telehealth obesity OSCE and reliable checklist for assessment of resident physicians: a pilot study.

BACKGROUND: Obesity is a major public health problem, yet residents undergo little formal training and assessment in obesity-related care. Given the recent growth of telehealth, physicians must further learn to apply these skills using a virtual platform. Therefore, we aimed to develop an objective structured clinical examination (OSCE) with reliable checklists to assess resident ability to take a patient-centered obesity-focused history that was feasible over telehealth based on published obesity competencies for medical education. METHODS: We developed a 15-minute telehealth OSCE to simulate an obesity-related encounter for residents modified from a script used to assess medical student obesity competencies. We designed three checklists to assess resident skills in history taking, communication and professionalism during the obesity-related encounter. Resident performance was assessed as the percentage of obesity-related history taking questions asked during the encounter and as the mean communication and professionalism scores on a scale of 1 through 5 with 1 representing unacceptable/offensive behavior and 5 representing excellent skills. Encounters and assessments were completed by two commissioned actors (standardized patients) and 26 internal medicine residents over a secure online platform. We assessed the reliability of each checklist by calculating the percent agreement between standardized patients and the kappa (κ) statistic on each checklist overall and by each checklist item. RESULTS: Overall agreement between standardized patients on the history taking, communication and professionalism checklists were 83.2% (κ = 0.63), 99.5% (κ = 0.72) and 97.8% (κ =0.44), respectively. On average, residents asked 64.8% of questions on the history taking checklist and scored 3.8 and 3.9 out of 5 on the communication and professionalism checklists, respectively. CONCLUSIONS: Results from this pilot study suggest that our telehealth obesity OSCE and checklists are moderately reliable for assessing key obesity competencies among residents on a virtual platform. Integrating obesity OSCEs and other educational interventions into residency curricula are needed to improve resident ability to take an obesity-focused history.

A Novel Mock Oral Curriculum for Senior Surgery Residents: Results of a Pilot Study.

INTRODUCTION: The oral general surgery certifying examination (CE) is required for board certification. A curriculum was designed to improve CE passage rates at an academic residency program. Limited literature exists that evaluates a long-term mock oral curriculum for senior residents. This study aims to evaluate the impact of this curriculum on essential elements for clinical practice and CE preparedness. METHODS: The curriculum consisted of weekly meetings with postgraduate year four and postgraduate year five residents (n = 10). Two residents were selected for a video-recorded board-style mock examination with a faculty examiner and peer audience. Each attendee completed a standard evaluation form that assessed score, anxiety, confidence, and medical knowledge. Blood pressure, pulse, and unused time were assessed. A postcurriculum survey was conducted. RESULTS: Medical knowledge had the greatest correlation with overall scores (R2 = 0.733). Positive correlations were seen between confidence and case number for faculty, self, and peer scores (R2 = 0.671, R2 = 0.566, and R2 = 0.729, respectively). There was a positive correlation between confidence and medical knowledge (R2 = 0.575). There was a significant difference between the overall score of nontachycardic versus tachycardic residents (P = 0.00994). CONCLUSIONS: Residents demonstrated increasing confidence as they progressed through the curriculum by self-reported and objective measures. Residents demonstrated improvements in overall scores. Future directions will examine results of the 2-y curriculum experience and CE passage rates to verify that a standardized, structured, weekly, longitudinal curriculum is beneficial for CE preparedness and clinical practice.

Development and Evaluation of Interactive Flipped e-Learning (iFEEL) for Pharmacy Students during the COVID-19 Pandemic.

BACKGROUND: Distance learning has come to the forefront of educational delivery throughout the world due to the COVID-19 pandemic. Presently, there is a paucity of studies that have utilized interactive e-lectures as a model for remote flipped learning. OBJECTIVES: To compare educational outcomes for the remote interactive flipped e-learning (iFEEL) activity versus paper-based in-class group learning (PICkLE). METHODS: During the spring 2021 semester, tutorials in pharmaceutical quality control and good manufacturing practice were remotely delivered to students by two different approaches: PICkLE and iFEEL. In the latter activity, interactive e-lectures were software-designed and included several audiovisual enhanced illustrations to encourage students to interact with the lecture material prior to attending the virtual class. The class time was reserved for in-class quizzes and discussion. Mean exam scores were compared and voluntary questionnaires were distributed among the participating students as well as healthcare faculty members in 29 Saudi universities. Data from the remotely-delivered course was compared with data from previous course offerings (2018-2020) that used the live PICkLE method. RESULTS: The mean score of post-lecture tests significantly (p < 0.05) increased compared to pre-lecture tests in remote PICkLE and iFEEL, respectively. iFEEL activity showed higher mean post-tests score (95.2%) compared to live PICkLE (90.2%, p = 0.08) and remote PICkLE (93.5%, p = 0.658). Mean comprehensive exam scores increased from 83.8% for remote PICkLE to 89.2% for iFEEL (p = 0.449). On average, 92% of students and 85% of faculty members reported positive feedback on the five quality attributes of the e-lecture. Over 75% of students preferred the iFEEL over PICkLE activity for future course offerings and 84% of faculty members recommend the integration of interactive e-lectures in their future courses. CONCLUSION: iFEEL represents a novel model of remote flipped learning and shows promising potential to be incorporated into live blended-learning classroom activities.

Use of digital teaching resources and predictors of medical student performance during the pandemic: A prospective study.

BACKGROUND: The coronavirus pandemic has led to increased use of digital teaching formats in medical education. A number of studies have assessed student satisfaction with these resources. However, there is a lack of studies investigating changes in student performance following the switch from contact to virtual teaching. Specifically, there are no studies linking student use of digital resources to learning outcome and examining predictors of failure. METHODS: Student performance before (winter term 2019/20: contact teaching) and during (summer term 2020: no contact teaching) the pandemic was compared prospectively in a cohort of 162 medical students enrolled in the clinical phase of a five-year undergraduate curriculum. Use of and performance in various digital resources (case-based teaching in a modified flipped classroom approach; formative key feature examinations of clinical reasoning; daily multiple choice quizzes) was recorded in summer 2020. Student scores in summative examinations were compared to examination scores in the previous term. Associations between student characteristics, resource use and summative examination results were used to identify predictors of performance. RESULTS: Not all students made complete use of the digital learning resources provided. Timely completion of tasks was associated with superior performance compared to delayed completion. Female students scored significantly fewer points in formative key feature examinations and digital quizzes. Overall, higher rankings within the student cohort (according to summative exams) in winter term 2019/20 as well as male gender predicted summative exam performance in summer 2020. Scores achieved in the first formative key feature examination predicted summative end-of-module exam scores. CONCLUSIONS: The association between timely completion of tasks as well as early performance in a module and summative exams might help to identify students at risk and offering help early on. The unexpected gender difference requires further study to determine whether the shift to a digital-only curriculum disadvantages female students.

Assessing the utility of virtual OSCE sessions as an educational tool: a national pilot study.

BACKGROUND: Objective Structured Clinical Examinations (OSCEs) are a common form of assessment used across medical schools in the UK to assess clinical competence and practical skills and are traditionally held in an in-person format. In the past, medical students have often prepared for such exams through in-person peer-assisted learning (PAL), however, due to the recent Covid-19 pandemic, many in-person teaching sessions transitioned to online-based formats. There is currently a paucity of research on the utility of virtual PAL OSCE sessions and thus, we carried out a national pilot study to determine the feasibility of virtual OSCE teaching via feedback from participants and examiners. METHODS: A total of 85 students from 19 UK-based medical schools with eight students based internationally attended the series of online OSCE workshops delivered via Zoom®. All students and examiners completed a feedback questionnaire at the end of each session regarding parameters, which included questions on pre-and post-workshop confidence in three OSCE domains: history-taking, communication and data interpretation. A Likert scale using 5 Likert items was used to self-report confidence, and the results were analysed using the Mann-Whitney U test after assessing for normality using the Shapiro-Wilk test. RESULTS: Results from student feedback showed an increase in confidence for all three OSCE domains after each event (p < 0.001) with 69.4% agreeing or strongly agreeing that online OSCE sessions could sufficiently prepare them for in-person exams. Questionnaire feedback revealed that 97.6% of students and 86.7% of examiners agreed that virtual OSCE teaching would be useful for preparing for in-person OSCE examinations after the pandemic. CONCLUSION: Most participants in the virtual OSCE sessions reported an improvement in their confidence in history-taking, communication and data interpretation skills. Of the participants and examiners that had also experienced in-person OSCE examinations, the majority also reported that they found virtual OSCE sessions to be as engaging and as interactive as in-person teaching. This study has demonstrated that virtual OSCE workshops are a feasible option with the potential to be beneficial beyond the pandemic. However, more studies are required to assess the overall impact on student learning and to determine the value of virtual OSCE workshops on exam performance.

Assessment of biomedical engineering knowledge using true-false questions.

The COVID-19 pandemic has caused a shift from on-campus to remote online examinations, which are usually difficult to invigilate. Meanwhile, closed-ended question formats, such as true-false (TF), are particularly suited to these examination conditions, as they allow automatic marking by computer software. While previous studies have reported the score characteristics in TF questions in conventional supervised examinations, this study investigates the efficacy of using TF questions in online, unsupervised examinations at the undergraduate level of Biomedical Engineering. We examine the TF and other question-type scores of 57 students across three examinations held in 2020 under online, unsupervised conditions. Our analysis shows significantly larger coefficient of variance (CV) in scores in TF questions (42.7%) than other question types (22.3%). The high CV in TF questions may be explained by different answering strategies among students, with 13.3 ± 17.2% of TF questions left unanswered (zero marks) and 16.4 ± 11.5% of TF questions guessed incorrectly (negative marks awarded). In unsupervised, open-book examination where sharing of answers among students is a potential risk; questions that induce a larger variation in responses may be desirable to differentiate among students. We also observed a significant relationship (r = 0.64, p < 0.05) between TF scores and the overall subject scores, indicating that TF questions are an effective predictor of overall student performance. Our results from this initial analysis suggests that TF questions are useful for assessing biomedical-theme content in online, unsupervised examinations, and are encouraging for their ongoing use in future assessments.